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@ Image capture apparatus. 

(St) a method and apparatus for controlling and 
displaying the image infonmation presently seen 
by the Image capture device together with those 
images which have been captured and stored 
upon actuation of the device. In a preferred 
embodiment, a viewfinder window is located in 
a capture device window. The capture device 
window also includes a variety of push buttons, 
some of which control the image capture de- 
vice, others of which control the way In which 
the captured images are displayed on the com- 
puter screen. In response to the user command 
to capture an image, the image will be displayed 
adjacent to the Image capture window. As the 
user continues to capture images, the frames 
are displayed as long as the computer has 
adequate temporary storage. Means to discard 
some images are also included in the user 
Interface. Preferably, the discarded Images are 
retained to allow the maximum reversibility of 
decisions to the discard images. The user inter- 
face also allows tiie user to stack a set of 
images into a single object in the worl<space. 
Images may be manipulated within tiie stack, 
discarded or modified or changed between 
stacks of image objects. 
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This invention relates generally to computer con- 
trol of machines, more particularly, it relates to image 
capture apparatus comprising an image capture cam- 
era coupled to a computer. 

Computer control of image devices such as a 5 
photo copier or x-ray or sonography Imaging devices 
is known. Menus listing possible selections are pre- 
sented in a display attached to the device. However, 
the hardware and software which control the image 
devices are typically special purpose and do not work io 
with other independently designed software or per- 
ipherals. The menus and display of images are map- 
ped to a physical display space within the overall dis- 
play. 

Further, the software designed for an x-ray, so- is 
nography or tomography device is usually very conrv 
plex. While the operator of the device is usually a 
highly trained technician and can learn to operate the 
imaging device, the user interface is not typically very 
user friendly. 20 

In general purpose computers, object oriented 
graphical user interfaces have been developed to en- 
able a user to interact with the computer system and 
t he data stored within by using an object-action para- 
digm. The user interfaces represent information such 25 
as data flies and the applications which manipulate 
the data file as objects. Objects are logical structures 
within the user interface. Each object will generally 
have some associated properties which constrain its 
behavior when acted on by the computer system. Ex- 30 
amples of such object oriented graphical user inter- 
faces include IBM's OS/2, Version 2.0, Hewlett-Pack- 
ard's NewWave and the operating systems of the Ap- 
ple Corporation. 

This invention provides image capture apparatus 35 
comprising an image capture camera coupled to a 
computer, the computer having an object oriented 
graphical user interface and comprising a display de- 
vice; means to cause display of a current image 
sensed by an image capture device In a first window 40 
on the display device; means responsive to a prede- 
termined user Input operation while a screen cursor is 
located over predetermined area of the display 
screen to store the current image in a second window 
on the display device. 45 

The present invention builds on the prior art to 
construct a simple, intuitive object-oriented user in- 
terface for confat>l of a digital image capture device. 

Amethod and apparatus are provided for display- 
ing an object oriented user interface, the interface so 
containing objects with image information presentiy 
seen by the image capture device together with ob- 
jects containing images which have been captured 
and stored upon actuation of the device. In the inter- 
face, objects are presented on the display as a win- ss 
dow or an icon. In a preferred embodiment, a view- 
finder window is located within a capture device win- 
dow^ The capture (jevice window also includes a va- 



rietyof push buttons, some of which control the image 
capture device, others which control the way in which 
the captured image windows are displayed on the 
computer screen. In response to the user command 
to capture an image, most likely from a push button, 
the image will be displayed in its own window along 
side the capture device window. As the user contin- 
ues to capture images, new image windows are dis- 
played as long as the computer has adequate tempor- 
ary storage. Means to discard some images are also 
included in the user interface. Preferably, the discard- 
ed images are retained in a trash stack object to allow 
the maximum reversibility of decisions to discard inv 
ages. The user interface also allows the user to stack 
a set of captured image objects into a single object in 
the workspace called a stack object. Images may be 
manipulated within the stack object, discarded or 
modified or changed between different stacks of im- 
ages. 

The invention allows a variety of users, novice to 
expert, to control an image capture session utilizing 
a computer assisted instant digital image capture de- 
vice. The session involves capturing images, evaluat- 
ing images and specifying the initial disposition of 
each captured image. 

This invention will become more easily under- 
stood by reference with the attached drawings and 
following description, wherein 

FIG. 1 is a representation of a notebook personal 

computer system, having attached a tethered 

digital image capture device; 

FIG. 1 is a representation of a notebook personal 

computer system, having attached a tethered 

digital image capture device; 

FIG. 2 is a block diagram of the computer sys- 

tenn/image capture device combination; 

FIG. 3 depicts several image applications active 

in the system memory together with a digital inr)- 

age capture control program according to the 

present invention; 

FIG. 4 illustrates the computer display containing 
the initial capture device window according to the 

invention; 

FIG. 5 is an illustration of the computer display in- 
cluding the capture device window and the first 
image capture by the image capture device; 
FIG. 6 is an illustration of a computer display de- 
picting the capture device window and two im- 
ages captured by the image capture device; 
FIG. 7 is an illustration of the capture device win- 
dow and a plurality of captured images surround- 
ing the window; 

FIG. 8 is an illustration of the set of images in FIG. 
7, in which a pop-up window is placed over an Im- 
age for manipulation; 

FIG. 9 is an illustration of the display in FIGs. 7 
and 8 after a first image has been discarded; 
FIG. 10 is an illustration of the user interface in 



3 



EP0 583 908 A2 



4 



which a stack object has been called; 
FIG. 11 shows the result of the stacking opera- 
tion; 

FIG. 12 is an illustration of the user interface dur- 
ing a second image capture session where the 
infiages captured in a first image capture session 
illustrated in FIG. 4 through 11 are stored in a 
stack object; 

FIG. 13 is an illustration of the user interface In 
which a stack operation menu is presented; 
FIG. 14 and 15 are illustrations of the user inter- 
face in which the flip pictures operation from the 
stack menu has been selected; 
FIG. 16 is an illustration where an image object 
has been taken from a stack object; 
FIG. 1 7 is an illustration of a user interface having 
a plurality of stack objects, image objects and the 
capture device window; 

FIG. 18 is an illustration of the user interface 
when a first image is permanently stored; 
FIG. 1 9a-1 9d show a flow diagram of the main inn- 
age capture device logic; 
FIG. 20 is a flow diagram of the logic for opera- 
tions within a picture window; 
FIG. 21 is a flow diagram of the logic for opera- 
tions within a picture stack object 
In FIG. 1, a notebook personal computer 100 pre- 
ferably one in the IBM PS/2 series of computers, conv 
prising a keyboard 112, a mouse 113 and a display 
114 is depicted. The screen of the display device is 
used to present the image during an image process- 
ing session. The computer is connected by means of 
a tether 117 to digital image capture camera 118. The 
tether 117 includes cables which carry power and 
control informatton to the digital capture device 118 
and the captured image data back to the computer 
100. 

Fig. 2 shows a block diagram of the components 
of the computer/ camera combination shown in Fig. 1 . 
The computer 100 includes a system bus 121 to which 
various components are coupled and by which com- 
munication between the various components is ac- 
complished. A microprocessor 122 is connected to 
the system bus 121 and is supported by read only 
memory (ROM) 123 and random access memory 
(RAM) 1 24 also con nected to system bus 1 2 1 . The mi- 
croprocessor 122 is one of the Intel family of micro- 
processors including the 8088, 286, 388, 486 or 586 
microprocessors. However, other microprocessors 
including, but not limited to Motorola's family of micro- 
processors such as the 68000, 68020 or the 68030 
microprocessors and various Reduced Instruction 
Set Computer (RISC) microprocessors manufactured 
by IBM, Hewlett Packard, Sun, Motorola and others 
may be used in a specific notebook computer. 

The ROM 123 contains among other code the 
Basic Input/Output System (BIOS) which controls ba- 
sic hardware operations such as the interactions of 




the disk drives 126 and 127 and the keyboard 112. 
The RAM 124 is the main memory into which the op- 
erating system and the image application programs 
are loaded, including the user interface of the present 
5 invention. The memory management chip 1 25 is con- 
nected to the system bus 121 and controls direct 
memory access operations including, passing data 
between the RAM 124 and a hard disk drive 126 and 
floppy disk drive 127. 

10 Also connected to the system bus 121 are three 
I/O controllers: the keyboard controller 128, the 
mouse controller 1 29 and the video controller 1 30. As 
might be expected, the keyboard controller 128 pro- 
vides the hardware internee for the keyboard 112, 

15 the mouse controller 129 provides the hardware in- 
terface for mouse 113 and the video controller 130 Is 
the hardware interface for the display 114. Lastly, an 
electronic camera controller card 132 is coupled to 
system bus 121 to provide control of the image cap- 

20 ture device 118. 

The logic inside the computer controls the cam- 
era 118 via a bus 131 In the electronic camera con- 
. troiler card 132. The controller card 132 could be a 
PCMCIA card. Inside the camera 1 1 8, a microproces- 

25 sor 140 exerts control over camera resources includ- 
ing the charge coupled device (CCD) array 1 38 which 
acte as an image sensor, a shutter 136 and a flash 
137. In the preferred embodiment the microproces- 
sor passes controls to the camera resources to the 

30 computer system 100 via tether 117, controller 132 
and bus 1 31 . These controls include triggering an ex- 
posure, triggering the flash 1 37. reading images from 
the CCD 138 or camera memory 139, and other cam- 
era functions. 

35 The operating system on which preferred enrv 

bodiment of the invention is implemented is IBM's 
OS/2 Version 2.0 operating system, although it will be 
understood that the invention could be implemented 
on other and different operating systems. As shown 

40 in FIG. 3, an operating system 150 is shown resident 
in RAM 124. The operating system 150 is responsible 
for determining which user inputs from the keyboard 
112 and the mouse 113 go to which of the applica- 
tions, transmitting those inputs to the appropriate ap- 

45 plications and performing those actions as specified 
by the application and response to that input For ex- 
ample, the operating system would display the result 
of the capture image to the user on the graphic dis- 
play 114. The operating system 150 includes a pre- 

50 sentation manager which is responsible for present- 
ing the applications in a uniform and consistent man- 
ner within the graphical user interface. For more in- 
formation on IBM's OS/2 operating system, the read- 
er is referred to OS/2 2.0 Programming Guide, Vol.11. 

55 Order No. 510G-6494-00. and OS/2 2.0 Presentation 
Manager Programming Reference, Vols. I, II and III, 
Order Nos. 510G-6264-00, 510G-6265-00. 51 OG- 
6272-00. Also resident in RAM 124, is the capture de- 

3 
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vice program 152 and a plurality of image programs 
1 54 through 1 60 which provide functions such as, im- 
age editing, color enhancement, image sizing, format 
conversion, archiving and image distribution. 

The user interface in the capture device code 1 52 5 
is designed to support digital still image capture de- 
vices. The user interface as illustrated in FIGs. 4-18 
and its underlying functions will be critical as image 
capture becomes more common, more portable and 
less expensive. While invention described herein io 
would apply to virtually any image capture situation, 
it is fully exploited in a doseiy integrated comput- 
er/capture device that produces essentially instant 
feedback for captured images. These closely integrat- 
ed capture devices are the most interesting because is 
they utilize the computer for traditional and non-tradi- 
tional control functions. Thus, the package cam 
era/computer Is far more integrated and also reduces 
the cost by not requiring the capture device to per- 
form all of the control functions independent of the 20 
computer. 

It should be noted, however, that many of the 
concepts described in this invention would also be 
beneficial in less integrated systems where the cap- 
ture device can perform some or all of the control 25 
functions, and even in those where the capture de- 
vk:e performs some of the Intermediate storage func- 
tions. Since the less integrated environments present 
essentially a subset of functions from that of the more 
closely Integrated environments, the remainder of 30 
this disclosure will concentrate on the closely inte- 
grated solution, making reference to the other envir- 
onments as appropriate. 

In the closely integrated system, the images tak- 
en by an instant camera are presented in the work- 35 
surface of the attached computer display for purpos- 
es of comparison, ordering, discarding, and initial dis- 
tribution. The system allows the user to capture im- 
ages and then evaluate those images for future use, 
e.g., decisions regarding retention. It assumes that all 40 
subsequent functions, e.g., image editing, color en- 
hancement, sizing, format conversion, archiving, and 
any other distribution will be the function of other im- 
age applications. 

The highly integrated computer/capture device 45 
utilizes the computerfor many of the control functions 
and all of the image display and selection functions. 
Of particular importance is the operation of the cap- 
ture device's viewf inder. As shown in FIG. 4, the com- 
puter provides the display of the viewf inder window so 
1 70 within the capture device window 175. The view- 
finder 170 could display anything from full color at vid- 
eo rates to black &white at only a few frames per sec- 
ond depending on the capabilities of the image cap- 
ture device and the computer. While some of these S5 
options may be more desirable than others, all pro- 
vide adequate viewfinder function to compose the 
scene before capturing the associated still images. As 
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both the viewf inder window 170 and capture device 
window 175 are logical objects with the workspace 
object within the OS/2 environment, they share all the 
advantages of display configuration and compatibility 
with other OS/2 objects. The workspace object usu- 
ally has the entire display at its disposal and all other 
objects displayed are contained within. The work- 
space could be unique to the capture device opera- 
tion or it could be the desktop object managed by 
OS/2. In the latter case, the workspace would likely 
contain other objects not necessarily related to the 
capture device picture selection operattons. 

A capture device window 175 also includes sev- 
eral exposed control buttons. The viewfinder control 
turns the solid-state array on so long as the power to 
the image capture device is also being supplied by 
the computer on actuation of the power button 178. 
An image is captured when the user selects the pic- 
ture button 177. The above controls control the image 
capture device. Also included in the capture device 
window 1 75 are controls which determine the method 
of presentation, selection and storage of the images. 
For example, the settings button 179 and 181 deter- 
mine the settings of the image capture device and of 
the displayed images on the computer screen respec- 
tively. The stack buttons 183 and 184 determine 
whether all images are to be displayed all images are 
to be stacked or rather only those which are currently 
display to be stacked. The display controls 186 and 
187 control global stacking functions. The first global 
stacking function allows "all" stacked images to be 
displayed along with currently displayed images (re- 
sulting in all workspace images being displayed). The 
second global stacking function allows only "stacked" 
images to be displayed which causes all currently dis- 
played images to be stacked. 

Exactly what occurs when power is turned on and 
when a picture is taken by pressing the picture button 
177 could be determined by user preference speci- 
fied by the use of the "settings" buttons 179, 181 func- 
tions. However, when the capture system was first 
used, it would be importantfor it to behave in a fashion 
that would be easQy understood by the beginning 
user, whether that user is experienced or Inexper- 
ienced in image applications. Thus, it is assumed that 
initially (i.e., before any user customization) that when 
the "Capture Device" application is started, the win- 
dow 175 shown in FIG. 4 would appear essentially 
centered on the computer screen, with the capture 
device powered on, and the viewfinder 170 also on. 
The user would see. within the viewfinder window 
1 70 what the capture device was currently seeing. To 
capture (take) a picture, the user would simply com- 
pose the desired scene in the viewfinder by moving 
the capture device, attached to the computer, and 
then press the "Picture" button "click". "Pressing" 
could be accomplished with a touch screen using a 
finger or a stylus, via a mouse or even with an asso- 
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ciated key from any attached keyboard. The result of 
pressing the control 177 would be to display a repre- 
sentative rendering of the image in its own window 
190 captured essentially instantly (hopefully within a 
second). The results of this operation could look as is 
Illustrated in FIG. 5. This image would be in color if the 
capture device was capable of color imaging. 

The user might be unsatisfied with the quality of 
the picture, e.g., lighter than desired, but would not 
want to discard the image because it might turn out 
to be the best one possible. In this case, which is the 
common case, the user would take another picture, 
by selecting the picture button 177. A second image 
window 192 appears along side the first image win- 
dow 190 as shown in FIG. 6. 

Now the lighting seems appropriate but the sub> 
jecf s facial expression is not what is desire and a third 
picture is taken. The user may then continue taking 
pictures as long as desired and as long as the com- 
puter has adequate temporary storage. This contin- 
ued operation could result in a plurality of image win- 
dows 190 - 200 displayed around the capture device 
window 175 portraying all the captured images in the 
user interface as shown in FIG. 7. 

At this point, the user may feel that there are 
enough pictures to choose appropriate ones, or may 
be forced to stop due to the subject no longer being 
available. If the user is sure that some pictures may 
not be wanted, they can be discarded by moving the 
cursor to the image and selecting the discard function 
as illustrated for a image window 196 in the FIG. 8. 

Discarding, shown in FIG. 8 as implemented via 
a pop-up menu 202, could also be implemented by 
some type of direct manipulation, selecting the appro- 
priate item by moving a cursor, depressing a mouse 
button or touching a touch screen. However, it could 
also be object manipulation (e.g., dragging the picture 
to a trash icon and dropping it on the icon, or dragging 
it to off the screen). The specific choice would depend 
on the user's preferences and the functions support- 
ed, or not supported, by the operating system. For ex- 
ample, dragging to the screen's edge might network 
in the case where the operating system's logical 
screen is bigger that the hardware's physical screen, 
and the cursor approaching the screens edge is a sig- 
nal for scrolling the logical screen. 

The result of the "Discard" operation would leave 
the screen as shown in FIG. 9. Note that as a result 
of the first delete one image window 196 is deleted 
from the screen and a "Trash Stack" object 204 was 
created to hold the discarded images as long as pos- 
sible. The trash stack object 204 will retain the dis- 
carded images until storage space is needed and 
then the oldest image(s) will be physically deleted to 
accommodate the newest deleted captured images. 
The trash stack 204 will allow the maximum possible 
reversibility of decisions to discarded images. Manip- 
ulation of this stack object 204 is similar to that descri- 



bed for normal "Picture stack" objects described be- 
low. However, none of the general stack display funo- 
tions are applicable, thus leaving only the ability to 
"flip" through the images in the trash stack 204. In an 
5 alternative embodiment, it would be possible to Initial- 
ize the capture application with an empty trash stack 
if that were deemed more desirable to support direct 
drag and drop deletes. 

If the user continued to take pictures until the 

10 screen area was filled with images, the user Interface 
would display subsequent pictures either by overlap 
ping them with previous pictures, or be automatically 
placing in a "Picture Stack" object The exact manner 
in which this overflow case would be handled de- 

15 pends upon the customization selected by the user 
under the "Settings wspace" button, and the particu- 
lar capabilities and limitations of the operating system 
upon which the capture application is running. 

The user could continue to take more pictures, or 

20 save and discard pictures. The save function results 
in an opportunity to specify some new path and file 
name different from the default if the user desires. 
When the save function is exercised, the image win- 
dow representing the image to be saved contains the 
• 25 pointer (cursor) when the save menu is selected just 
as with the "Discard picture" function. If the user 
saves the image, the image window object is re- 
moved from the work space just as when the image 
was deleted, except, of course, that the image is 

30 saved on permanent storage instead of being re- 
moved form the system. If the user wishes to delay 
saving a picture, he/she can put all Images destined 
to be saved in a picture stack as described below for 
saving after all selection decistons have been made. 

35 The user interface allows for one additional level 
of work space segmentation. This is the "Picture 
Stack". The picture stack is an object on the work 
space just like the captured Image object; it repre- 
sents a temporary repository which can contain any 

40 number of images on the work space. Picture stacks 
are created when the user attempts to place any inv 
ages or set of images into a stack that does not al- 
ready exist At initiation for the first time, there are no 
picture stacks and the user can operate indefinitely 

45 as described above without the use of pictures stacks 
in any way. However, when the user's picture capture 
session requires the temporary retention of more pic- 
tures than can be displayed directiy on the work 
space it may be desirable, and helpful as well, to put 

so certain pictures Into picture stacks to temporarily free 
up display area on the screen for subsequent pic- 
tures. 

The user interface is designed to help the user in 
selecting the "keepers", the images to actually save, 
55 without requiring him to make premature choices. 
Otherwise, the user might possibly discard images 
that would have later proved to be the best choices. 
The processing and storage capacities of the comput- 
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er, the close integration of the capture device, and the 
essentially instantaneous results from the taking of a 
picture all serve to make this environment much more 
productive and error free than the current instant 
camera processes. Alternatively, picture stacks could 5 
be created by direct manipulation, e.g., placing one 
picture directly on top of another picture, by dragging 
and dropping. 

Next, the user wishes to temporarily retain the inn- 
ages already captured, less the one discarded, in a 10 
picture stack object as described above and go on to 
another subject In the user interfiace displayed in 
FIG. 8. the user could individually stack each image 
by placing the mouse pointer on the image window 
and using the "Stack picture" function or dragging and is 
dropping the picture on the stack object Each individ- 
ual image could be directed to different picture stacks 
as the user desired. An alternative method is to place 
all images that are on the display in a stack. This is 
accomplished by selecting the appropriate option 20 
from the main window via one of the "Stack" buttons. 
In FIG. 8, either option would perform equally well be- 
cause all images are visible and completely displayed 
without being overlapped by some other image. As il- 
lustrated in FIG. 8, the user could select the subordin- 25 
ate menu indicated by the right facing arrow to spec- 
ify a stack name, but in this case will accept the de- 
fault naming which will result in the creation of a pic- 
ture stack named "Stack 1" 206 which will appear as 
a icon on the screen and all pictures will be placed in 30 
that newly created stack. An illustrative user interface 
display is shown in FIGs. 10-11. An alternative en> 
bodiment option for displaying a picture stack would 
be to show the stack with the first picture in the stack 
on top. It would not be necessary to name the stack 35 
because it would be identified visually by the dis- 
played picture. 

The user could continue image capture with the 
next subject. As above, several new images are cap- 
tured of the new subject and displayed in new image 40 
windows 208-212 as is illustrated in FIG. 12. The user 
uses the user interface to handle each image in the 
present set of image windows 208-212 as he/she did 
with the previous group of images. 

In FIGs. 12 and 13, the previous set of image ob- 45 
jects is in temporary storage in the "Stack 1" object 
208. Images from the stack 208 may be displayed in 
several ways. One would be to display the stacked 
pictures via the "Display" function buttons on the main 
capture device window 1 75. The "Display ail" button so 
186 would display the contents of all stacks, except 
the trash stack 204, along with those images current- 
ly displayed, thus resulting in the full display of all inv 
ages on the temporary work space. "Display all" 
might well result in the overlap of some images. Alter- ss 
natively, the user could display the stacked images, 
via the "Display stacked" button which would result in 
the stacked images being displayed while at the 



same time placing the currentiy displayed images in 
a new stack object In this way, the user could toggle 
between the two sets of images, each alternative 
stored in its own stack object 

Another very helpful feature is to go to thejstack 
object 206 via the pointer and flip through the Images 
one by one in a manner similar to a user flipping 
through stacks of physical pictures on a physical work 
space. It should be noted that the stack could be flip- 
ped by direct manipulation, for example, select the 
stack with the pointer and flip to next picture with 
each additional select, like a new touch or a mouse 
button depression. The flip stack function is illustrat- 
ed, using a pop-up menu 218, in the FIGs. 13-15. 

When the desired picture 198 is located as shown 
in FIG. 15, the user could bring it to the work space 
by either executing a command from a pop-up menu 
or dragging the image window 1 98 to the general area 
of the work-space. This would result in the display 
shown in FIG. 16. 

The user might discard the unwanted images and 
save the desired images 198 and 208. or might stack 
the unwanted images in a new stack object 220. This 
new stacking operata'on directed to specific images, 
for example, the 2nd through 5th image windows 209 
through 212 (FIG. 12) could result in the user inter 
face as shown in FIG. 17. 

The desired images 198 and 208 could be saved 
using the save dialog box 222 as illustrated in FIG. 1 8. 
The save dialog box 222 contains a field which con- 
tains the name under the desired image 198 and 208 
will be stored in permanent storage in the note book 
computer. 

The user would save the remaining image as with 
the previous image and then either continue the ses- 
sion or end the operation. The existing images in pic-' 
ture stacks would either be saved or deleted depend- 
ing on the specific user customization. 

The picture displays in the user interfece could 
be set to different sizes to accommodate the users 
desire to get more or less nonoverlapping images on 
the screen at one time. Often quality and perfor- 
mance can be traded off for screen real estate. These 
functtons could be accommodated via the settings 
functions of real-time functions allowing the user to 
adjust the sizes as needed during the capture ses- 
sion. 

This approach would support capture devices 
that provide their own control functions and even 
those that have local storage capabilities. In these 
cases, the applications would start by downloading 
the images from the capture device, the images 
would appear on the workspace and thus the process 
of selection would be as described above without the 
instant feedback as each picture is taken. 

FiGs. 19A-19E comprise a flow diagram for the 
main image capture device application program. In 
FIG. 19A, the application starts 300 when the oper- 
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ating system receives a command to initiate operation 
of the image capture device application program 302. 
This could be done, for example, by clicking on a cam- 
era icon on the OS/2 desktop representing the image 
capture device application, to "open" the application. 5 
Next, the operating system creates the capture de- 
vice window by calling data associated with the appli- 
cation 304. This data also includes the command ob- 
jects within the capture device window, e.g., the pic- 
ture, viewf inder and power buttons 306. The capture io 
device object is presented on the computer display 
substantially as shown in FIG. 4. 

Next, a test is performed for a default profile for 
the image capture device application 308. The profile 
might contain information on whether the image cap- is 
ture device should be powered upon window opening, 
diagnostic routines run and initial control values gov- 
erning presentation of the images. If so, the profile is 
set up 310. If there is an error found during the diag- 
nostic routines 312, a message will be presented on 20 
the computer display 314. 

The flow diagram now shifts to FIG.19B. A test 
316 is performed to determine whether the viewf ind- 
er is to be initiated as "on" or "off. This information 
can be found in the profile. If so, the viewf inder object 25 
is created within the capture device window 318. The 
image information inside the viewfinder window 
changes as new images are sensed by the CCD array 
in the camera. Next, a test Is performed whether the 
user has requested that the system capture an image 30 
320 by clicking with a mouse button when the cursor 
is over the picture button in the capture device win- 
dow. If so, the camera Is set into image capture mode 
322, a capture request is set to the camera micropro- 
cessor 324, and the image Is taken with the appropri- 35 
ate exposure length and flash. The image captured by 
the CCD array of the camera is temporarily stored in 
the camera memory and then read into the main 
memory of the computer 326. The image information 
is used to create a new image object which is posi- 4o 
tloned on the display as shown in FIG. 5. The view- 
finder mode is restored if before the image was cap- 
tured, the viewfinder was on 330. 

If there was no image capture request, or rf the 
image capture request was complete, a test is per 45 
formed to determined whether the viewfinder should 
be toggled 332, i.e., the user clicked over the view- 
finder button. If the answer is yes, the viewfinder win- 
dow is hidden if it is currently shown, or it is revealed 
if it is currently hidden 334. There is a test 336 wheth- 50 
er the power should be toggled. If not, the test is per- 
formed whether image objects in any existing stack 
object should be displayed 338. If not, the process 
goes to H in FIG. 1 9D. If so. a test is performed wheth- 
er the image objects should all be displayed or only 55 
those in the current stack 340. If all are to be dis- 
played step 354 in FIG. 19C is performed where the 
appropriate action is to display all captured image ob- 



jects best as possible. If the only those which are in 
a particular stack object are to be displayed, first a 
new stack object is to be created 352 for the currently 
displayed images, then the images in the existing 
stack object are placed in to image windows 354. 

If the power is to be toggled 336, i.e., the user has 
clicked on the power button in the capture device win- 
dow, the procedure flows to D in FIG. 19C where a 
test is made to determine whether the power is on or 
off 342. If it is on, the camera power is turned off 344, 
presumably because the picture session has ended. 
The method then continues back to the tests In FIG. 
1 9B on how the captured images should be displayed 
on the computer screen. If the image capture device 
power is off, a test is performed to determine whether 
a capture device window has been opened. If so, the 
camera power is turned on. If not, the user is request- 
ed to Identify the image capture device application 
program and the capture device which is to controlled 
350. Then the method returns to A in FIG. 19A. 

Once the requested image windows are dis- 
played as requested, in FIG. 19D, a test is performed 
whether the user has asked for a stack pictures op- 
eration 356. If so, a test is performed whether all im- 
age objects currently displayed should be placed in 
the stack object or only those which are fully visible, 
on top of other image windows 358. Processes 360, 
362 are performed to identify either all image objects 
in an image window or only those which are fully visi- 
ble as appropriate. Once the image objects are iden- 
tified, they are placed in the stack object, preferably 
in the order in which they were taken, then the un- 
needed image windows deleted from the user inter- 
face 364. 

Proceeding to FIG. 19E, a test 366 is performed 
whether the user has requested to change any of the 
camera/computer settings. Next, a test is made 
whether device or workspace parameters are to be 
changed 368. If the device or camera settings are to 
be changed, a menu of the current settings are dis- 
played and changes are accepted If made by the user 
370. The new changes are sent to the camera 372, 
tests performed to determine whether the new set- 
tings were changed successfully 374, and error mes- 
sages sent back to the computer if the new settings 
were not successfully made 376. 

If the workspace parameters are to be changed, 
a menu showing the current setting is displayed, 
changes in the parameters made according to user 
specifications and the display refireshed to reflect 
those changes 378. 

A test 382 is performed whether the user has in- 
dicated that the application is to be ended 382. If not, 
the procedure returns to C in FIG. 198. If so, the Inrv 
age objects currentiy displayed in image windows or 
temporarily stored in the stack objects are either 
saved or discarded according to the workspace de- 
faults or user commands made during the image cap- 
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ture session 384. The application ends 386 and the 
display is returned to the OS/2 desktop. 

FIG. 20 is a flow diagram for the operations within 
an image or picture window. The process starts 400 
when a specific picture is chosen by the user, i.e., the 5 
mouse pointer is placed over the image window and 
a mouse button depressed 402. Depending on the 
embodiment of the user interface implemented, eith- 
er a pop-up menu, e.g., a discard menu, will appear 
or the user will perform a grab and drag operation, io 
e.g., grabbing the image window and dragging it to a 
trash stack icon 404. A number of tests are performed 
to determine whether the user wants to save the pic- 
ture 406, discard the picture 414 or stack the picture 
41 8. If the picture is selected for permanent storage, is 
the user is presented with the default name and of- 
fered the opportunity to change it if desired 408. The 
image object is saved with the specified or default 
name and the image window is deleted from the dis- 
play 410. The process ends 412. If the image object 20 
is to be discarded, the picture is removed from tem- 
porary storage and discarded 416. The discard may 
be into the specialized trash stack object which may 
allow the user to change his mind. If the picture is to 
be stacked in a stack object, the image object is 25 
placed in the identified stack object at a position as 
specified in workspace settings, e.g., chronological 
order, and the Image window is deleted from the user 
interface display 420. The operation ends 422. 

FIG. 21 is a flow diagram for flip operattons with 30 
a stack object The process starts 500 as a selected 
stack is specified by a user, e.g., the mouse cursor is 
placed over the stack icon representing the stack ob- 
ject in the interface 502. Next, a stack operation is se- 
lected by the user 504, in this case the flip operation. 35 
The user will be able to flip through the stack display- 
ing in turn ail the images in the stack object. If the 
stack is empty 506. the program ends 508. If the stack 
object has image objects embedded therein and the 
stack operation chosen is to flip through the stack, a 40 
test 510 is performed to determine which direction 
the stack object is to be flipped. This could be by de- 
fault setting in the profile or by a user selection on the 
flip menu. If the forward direction is chosen, top in> 
age object handle is placed at the bottom of the list 45 
which holds the image object handles in the stack ob- 
ject 512 and the next image object, now the new top 
image object is displayed 514. If the flip direction is 
backward, the bottom image object handle is taken 
from the bottom of the handle list in the stack object 50 
and placed first 516. Since the old bottom object is 
now the new top object, it is displayed 514. The proc- 
ess ends 518, although the user can restart the proc- 
ess 500 rf he wishes to continue flipping through the 
stack. 55 

The specification has not gone into great detail in 
the creation of window handles forthe various objects 
in the user interface nor discussed the data struc- 



tures which contain the data used to determine the 
objects' behavior. As the invention is preferably run in 
OS/2, the reader is referred to the OS/2 2.0 referenc- 
es cited above with which many application prograo)- 
mers are familiar. 

As digital image capture becomes more feasible 
on more computer platforms the need for simple yet 
sophisticated operation becomes paramount to the 
success of expanded usage. Digital image capture 
does notyetofferthequality available with film based 
cameras; however, the quality is becoming more gen- 
erally usable and the unique aspects of computer at- 
tached instant capture devices can be exploited to of- 
fer compensating benefits over film based image cap- 
ture for many applications. This invention offers a 
familiar model with all the benefits of the near instant 
results in digital image capture. In addition to control- 
ling the capture device, the invention manages a 
workspace on the computer's screen in a natural and 
efficient way to allow full exploitation of the power of 
digital image capture. As these attachments become 
more and more viable for portable (i.e., battery oper- 
ated) computers this work space management be- 
comes critical to the efficient operation of the comput- 
er with the attached capture device. 

While the invention has been described with re- 
spect to particular embodiments above it would be un- 
derstood by those skilled in the art that modifications 
may be made without departing from the skill and 
scope of the present invention. These embodiments 
are for purposes of example and illustration only and 
are not to be taken to limit the scope of the invention 
narrower than the scope of the appended clainis.. 



Claims 

1. Image capture apparatus comprising an image 
capture graphical user (118) camera coupled to a 
computer (100), the computer having an object 
oriented interface and comprising a display de- 
vice (114); means to cause display of a current 
image sensed by an image capture device in a 
first window (170) on the display device; means 
responsive to a predetermined user input opera- 
tion while a screen cursor is located over prede- 
termined area (177) of the display screen to store 
the current image sensed by the image capture 
device, to generate an object associated with the 
stored image and to cause display of the stored 
image In a second window (190-200) on the dis- 
play device (114). 

2. Image capture apparatus as claimed in claim 1 
wherein the computer comprises means to gen- 
erate an object associated with a plurality of stor- 
ed image objects whereby the plurality of image 
objects can be manipulated as a group. 



8 



15 



EP 0 583 908 A2 



16 



3. A method for controlling an image capture device 
coupled to a computer system comprising the 
steps of: 

displaying a image capture device object 
on a computer system display, the image capture s 
device object containing a viewfinder object 
which includes a display of a current image 
sensed by the image capture device and control 
objects which if selected cause the computer to 
send control signals to the image capture device; io 

responsive to the selection of an image 
capture control object, capturing a first image 
sensed by the image capture device; 

creating a first image object containing the 
first Image; and, is 

displaying a representation of the first inn- 
age object in a first window on the computer sys- 
tem display. 



An image capture device coupled to a computer 20 
system comprising: 

an image capture device object stored in a 
memory and for presentation on a computer sys- 
tem display, the image capture device object con- 
taining a viewfinder object which includes a dis- 25 
play of a objects which if selected cause the com- 
puterto send control signals to the Image capture 
device; and, 

a first image object stored in the memory 
containing a first Image captured by the image 30 
capture device, a representation of which is pre- 
sented in a first window on the computer system 
display. 

A user interface for controlling an image capture 35 
device coupled to a computer system comprising: 

an image capture device object stored in a 
memory and for presentation on a computer sys- ^ 
tem display, the image capture device object con- C 
taining a viewfinder object which includes a dis- 40 1 
play of a current image sensed by the image cap- 
ture device and a set of control objects which if se- 
lected cause the computer to send control signals 
to the image capture device; and, 

a first image object stored in the memory 45 
containing a first image captured by the image . 
capture device, a representation of which is pre- 
sented in a first window on the computer system 

display. ^ 
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7) Bei einem Verfahren zur bidirektionalen drahtlosen Ober- 
tragung von Daten zwischen einer Tastatur (1) und einem 
zugeordneten Rechner (2) ist vorgesehen, daB von einer 
Sender-Empfanger-Einheit der Tastatur (1) ausgesandte 
Datenimpulse uber einen ersten monodirektionalen Lei- 
tungszweig (5) an eine drahtlose Qbertragungsstrecke (9) 
und von dieser an eine Sender-Empfanger-Einheit des 
Rechners (2) weitergegeben werden. Die von der Sender- 
Empf anger- Einheit des Rechners (2) ausgesandten Datenim- 
pulse werden uber einen zweiten monodirektionalen Lei- 
tungszweig (6) an eine drahtlose Qbertragungsstrecke (14) 
und von dieser an die Sender-Empfanger-Einheit der Tasta- 
tur (1) weitergegeben. Die Obertragung von Datenimpulsen 
in einem Leitungszweig (5, 6} spent die gleichzeitige 
Obertragung von Datenimpulsen in dem anderen Leitungs- 
zweig. Zusatzlich zu den Datenimpulsen werden Taktimpulse 
zwischen den.belden Sender-Empfanger-Einheiten in glei- 
cher Weise ubertragen. Es ist welter eine Schaltung zur 
bidirektionalen Obertragung vorgesehen, die zwei voneinan- 
der getrennte monodirektionale Leitungszweige (5, 6) hat, in 
denen jeweils in Senderichtung ein erster Inverter (7, 12), ein 
UND-Giied (8, 13), eine drahtlose Qbertragungsstrecke (9, 
14), ein zweiter Inverter (10, 15) und eine Diode (11. 16) 
angeordnet sind. Die die jeweilige drahtlose Qbertragungs- 
strecke (9, 14) verlassenden Impulse des einen Leitungszwei- 
ges (5, 6) werden uber einen dritten Inverter (17, 20) an das 
UND-Glied (8, 13) des ... 
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